A production system for massive data processing in ILCSoft
نویسندگان
چکیده
This memo presents a new production system for massive data processing on the Grid and other large computing facilities. The system is primarily targeted at being used with programs from the ILCSoft software framework developed partly within the EUDET project. The new system is written in Python and centered around a MySQL database. It provides the functionality that is needed for the submission, monitoring and bookkeeping of many thousands of jobs on the Grid. The same database that is used for the bookkeeping of the production serves also as the basis for a data catalog that can be queried through a webinterface. ∗Deutsches Elektronen-Synchrotron, Hamburg, Germany
منابع مشابه
Source Apportionment Of High Reactive Volatile Organic Compounds In a Region With The Massive Hydrocarbon Processing Industries
In the Persian Gulf region, conditions are highly favorable for ozone air pollution and the region is a hot spot of photochemical smog. The vast activities in processing oil and gas play a major role in it. It was found that the elevated concentrations of reactive hydrocarbons co-emitted with nitrogen oxides from Hydrocarbon Processing facilities lead to substantial ozone production. South Pars...
متن کاملPothole Detection by Soft Computing
Subject- Potholes on roads are regarded as serious problems in the transportation domain and ignoring them leads to the increase of accidents, traffic, vehicle fuel consumption and waste of time and energy. As a result, pothole detection has attracted researchers’ attention and different methods have been presented for it up to now. Background- The major part of previous research is based on i...
متن کاملOptimal Batch Production for a Single Machine System with Accumulated Defectives and Random Rate of Rework
In this paper we consider an imperfect production system which produces good and defective items and assume that defective items can be reworked. Due to the nature of rework process we do not restrict the rework rate to be equal to normal production rate or constant and assume that it is a random variable with an arbitrary distribution function. We also assume as it is true in most real world s...
متن کاملGeneric Plan of Food Safety Management System Based on ISO 22000:2005 for Aflatoxin Control in Raw Pistachio Processing Units from Raw Material Reception to Packaging
Pistachio is one of the most important agricultural crops of Iran. It is a nut from Anacardiacea family and its domesticated species is called Pistacia vera L. Regarding to pistachio importance and usage and by the expanding of pistachio cultivate, it is necessary to improve agricultural situation and by establishing well equipped processing and packaging units near the farms, it is possible to...
متن کاملA Robust Model for a Dynamic Cellular Manufacturing System with Production Planning
In this paper, a robust optimization approach is proposed to design a dynamic cellular manufacturing system (DCMS) under uncertainty of processing time of products. In addition, a mathematical model considering cell formation, inter-cell design and production planning under a dynamic environment (i.e., product mix and demand are changed in each period) is presented. Therefore, reconfiguration b...
متن کامل